A general method to determine replica symmetry breaking transitions 
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We introduce a new parameter to investigate replica symmetry breaking transitions using finite-size 
scaling methods. Based on exact equalities initially derived by F. Guerra this parameter is a direct 
check of the self-averaging character of the spin-glass order parameter. This new parameter can be 
used to study models with time reversal symmetry but its greatest interest concerns models where 
this symmetry is absent. We apply the method to long-range and short-range Ising spin glasses with 
and without magnetic field as well as short-range multispin interaction spin glasses. 



The subject of replica symmetry breaking has be- 
come an important issue in statistical physics Since 
rephca symmetry breaking was proposed long time ago 
1^ there have been several new developments concern- 
ing spin glasses as well as their applications in other 
areas of statistical physics. The implications of the re- 
sult whether replica symmetry breaking takes place in 
real physical systems can be of the outmost importance. 
Leaving aside the question whether and how this transi- 
tion could be observed in real experiments, it is certainly 
relevant to establish the validity of mean-field theory for 
spin glasses when applied to short-range systems. In this 
context, quite recently a new controversy has appeared 
on the problem whether self-averageness (i.e. the inde- 
pendence of the order parameter on the microscopic re- 
alization of the quenched disorder) is automatically sat- 
isfied in short-range systems. While the answer to this 
question (according to heuristic arguments by Newman 
and Stein Q ) appears to be closely related to the proper 
definition of the order parameter and how the thermo- 
dynamic limit is taken, there are few doubts that non 
self-averaging is the crucial signature for a spin-glass sce- 
nario where replica symmetry breaks. 

The purpose of this letter is to unambiguously show 



that indeed replica symmetry (hereafter, referred to as 
RS) breaks in short-range spin-glasses and that the gen- 
uine feature of the broken phase relies on the non-self 
averaging character of the order parameter. While the 
major part of work in spin glasses has been focused in 
models where there is a time reversal symmetry in the 
Hamiltonian this is not an essential requirement for the 
existence of a replica symmetry breaking (RSB) transi- 
tion. In models with time-reversal symmetry (hereafter 
referred as TRS), RS and TRS break simultaneously at 
the spin-glass transition temperature. Because both RS 
and TRS break precisely at the same temperature, it is 
very difficult to distinguish the different features related 
to both transitions. Indeed, the main distinction between 
the droplet and the mean-field approaches relies on 
which symmetries break at the spin-glass transition tem- 
perature. While in the first approach only TRS breaks at 
the transition temperature, in the second approach both 
symmetries break. The most widely used parameter to 
locate spin-glass transitions (the Binder parameter) sig- 
nals the breaking of time reversal symmetry rather than 
the other. Consequently, the major part of numerical cal- 
culations using the Binder parameter do not show that 
RS breaks at the spin-glass transition temperature but 
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rather whether TRS breaks. Then, it is essential to look 
for signatures of replica symmetry breaking in models 
where time reversal symmetries are lacking. 

A large class of models where TRS is not present are 
spin glasses in an external magnetic field or multispin p- 
interactions spin-glass models (p-SG) with p odd. The 
first class of models can be described by Hamiltonians of 
the type, 



H = 1-10 — ft-^CTi = — ^ Ji. 



(1) 



where the term h breaks the TRS [a — > —a) of 

the Hamiltonian Tio- On the other hand, models of p-SG 
take the general form. 
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For p odd TRS is absent. The interest of this last 
family of models (contrarily to (^) relies on the fact that 
there is no parameter which appropriately tuned restores 
TRS (this happens in the family of models of eq. (|^) where 
TRS is recovered if /i = 0). 

When studying phase transitions in ordered systems 
one generally computes the temperature dependence of 
cumulants of the order parameter distribution such as 
susceptibilities (for instance, second moments) which 
usually display power law divergences. Also, one can 
consider adimensional parameters such as the kurtosis 
(usually known as Binder parameter) or the skewness of 
the order parameter distribution. These adimensional 
parameters are related to the amplitudes of the scaling 
quantities in the renormalization group flows and they 
are good indicators for the transition. They find their 
most successful application in finite-size scaling studies. 

The usefulness of these quantities to distinguish RSB 
transitions is hampered by the fact that finite-size cor- 
rections to the leading scaling behavior of the Binder pa- 
rameter can be big. For RSB transitions it is then conve- 
nient to consider adimensional quantities which depend 
on other genuine features of the transition (and not only 
on TRS) such as self-averageness. Our purpose here is to 
define a suitable parameter which is the analogous of the 
Binder parameter for transitions where TRS breaks and 
which can be used to locate spin-glass transitions where 
RS breaks. In spin-glasses the order parameter is not the 
global magnetization but a measure of the freezing of the 
spins, the Edwards- Anderson parameter q The ap- 
propriate way to compute this parameter is to consider 
two replicas (i.e. two identical copies of the same system) 
and compute the overlap, q — {^/V) ^i'^i where V 
is the size or volume of the system. Expectation values of 
the moments {q^)BG allow to reconstruct the order pa- 
rameter distribution Pj{q) where {■■■)bg stands for the 
usual Boltzmann-Gibbs average for a given sample. It 



has been recently shown by F. Guerra |^ that sample to 
sample fluctuations of the cumulants of the order param- 
eter distribution Pj{q) are Gaussian distributed in the 
thermodynamic limit. For instance, the following rela- 
tionship is fulfilled in spin glasses in the low temperature 
phase below Tc, 



G = 



Vmq-{q)BGr)BG-XSG 



(3) 



where (.) means average over the quenched disorder 
and XSG (the spin-glass susceptibility) is defined as 



XSG 



V{{q^)BG 



{<i)bg) 



(4) 



The interest of defining the parameter G is that it van- 
ishes above the transition temperature in the disordered 
phase where sample to sample fluctuations of Pj{q) dis- 
appear in the V —> oo limit. Similar information to that 
obtained from (||) can be also gathered from the sample 
to sample fluctuations of xsg. 



x|g ~ Xsg 
XsG 



(5) 



which only involves the first and second moments of 
the order parameter. As we will see later yields also 
non trivial behavior in the low temperature phase even 
though (in contrast to G) it does not necessarily con- 
verge (in the thermodynamic limit) to a temperature in- 
dependent value. Consequently, G is a parameter which 
plays the same role as the usual Binder parameter g 
in ferromagnets and is given (in the V —>■ oo limit) by 
G{T) = (1/3)(1 - Qh{T - Tc)) where Qr is the Heavi- 
side theta function. In RSB transitions (^) goes to zero 
(as the size V increases) as 1/V for T > Tc but con- 
verges to a finite value for T < Tc- We expect the critical 
temperature (where RS breaks) to be signaled by the 
crossing of the different curves corresponding to different 
lattice sizes. Furthermore, close to Tc it is reasonable to 
expect, G{T) ~ G{L/^) where ^ is a correlation length. 
We stress that the calculation of G is specially useful in 
models where TRS is absent. In the presence of TRS 
the usual Binder parameter g can be used to locate the 
phase transition with much less numerical effort. But the 
interest of G is that it emphasizes the non-selfaveraging 
character of the low temperature phase. 

To check these predictions we have performed numer- 
ical simulation of models of the previous type (|^) (with 
and without magnetic field) and the p-spin model (|^). 
All the simulations use the parallel tempering method, 
an efficient algorithm to thermalize small samples 0. 
We have studied three different models, the mean-field 
Sherrington-Kirkpatrick (SK) model the four dimen- 
sional (4D) Ising spin glass, an the model eq.(H) in four 
dimensions with p = 3. In this last case, the Hamiltonian 
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is short-ranged, there are two spins per site in a 4D sim- 
ple cubic lattice and the Hamiltonian couples all possible 
triplets of spins occupying nearest-neighbor sites of the 
lattice. More precisely the Hamiltonian reads, 
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+ -^(2:'l2)^2'^^"4^") (6) 



where the pair (z, /i) denotes the link of the lattice and 
the spins {al, a^) occupy the same site i in the lattice. 
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FIG. 1. G in the 4D Ising spin glass without a field. The 
horizontal line indicates the expected low T result G = 1/3 
while the vertical line indicates the expected transition tem- 
perature derived form other methods Error bars are 
shown for L = 4, 10. 

First, we show the results in the four dimensional Ising 
spin glass without a magnetic field {h—Q) . This is a check 
of our method since the transition is well known using 
standard methods The model is described by eq.(|l|) 
with the Jij = ±1 connecting nearest- neighbor sites of in 
a cubic lattice of side L with periodic boundary condi- 
tions. The simulations were done for sizes L = 4, 5, 8, 10 
(2944, 1920, 1376, 320 samples respectively) with 100000 
Monte Carlo steps (MCS) of thermalization time and the 
same amount of steps to collect statistics (for L = 10 we 
did runs up to 35 million of MCS). Figure 1 shows the 
results for G. Note the existence of a critical tempera- 
ture above which G goes to zero and below which it con- 
verges to 1/3. The different curves cross at a temperature 
in agreement with that derived from the analysis of the 
usual Binder parameter ]To[ | and also series expansions 
1^ (Tc ~ 2.03). We have also analyzed the parameter a 
of cq.(p|) which shows that q;(L) ~ 1/1^ for T > while 



a{L) ~ a(oo) + A/L^ with ^ > for T < giving 
qualitatively the same information as G. 

Next we consider models without TRS. We first con- 
sider the study of the SK model in a magnetic field. The 
SK model corresponds to eq.(|^) with long-ranged 

and Gaussian distributed with Jy = ^T^ij — 1/^- The 
existence of a transition in a field is well established in 
mean-field theory but there are few results which cor- 
roborate its existence using numerical simulations [prf . 
Figure 2 shows G{T) for V = 32, 256, 512, 1024 with 
1000,1000,400,150 samples respectively. While it is very 
difficult to see evidence for this transition with the usual 
cumulants (skewness or Binder parameter) the situation 
turns out to be more clear with the parameter G where 
a merging close to T ~ .6 — .7 (below TcQi = 0) = 1) is 
observed. The figure clearly shows the existence of two 
temperature regions. A high temperature region where G 
goes to zero with the volume (as 1 /V) and a low tempera- 
ture one where G converges to 1/3 (within the precision of 
the statistics). This shows the existence of the Almeida- 
Thouless line in the SK model, a result well known in the 
mean-field theory of spin glasses but difficult to observe 
numerically. 
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FIG. 2. G in the SK model at ft = 0.3. Error bars are 
shown for V = 32, 1024. The difi'erent curves merge at 
a temperature well compatible with the theoretical result 
T^{h = 0.3) = 0.65 ||l|. 

The results in the four dimensional Ising spin-glass 
model in a field are shown in figure 3. Simulations were 
done at a magnetic field h = 0.4 with statistics ranging 
from 20000 MCS for L = 3 up to 450000 for L = 9. We 
observe also here a behavior very similar to that found 
in figure 2. The existence of the two regions (a high tem- 
perature one where G goes to zero and a low temperature 
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one where G converges to a finite value close to 1/3) is 
also clear from the plot. 

Figures 2 and 3 show quite unambiguously that there 
are two regions where self-averaging properties are quite 
different. This is a strong indication in favor of the exis- 
tence of a RSB phase transition in spin glasses in a mag- 
netic field. But a scale invariant crossing point is not so 
clearly observed in figures 2 and 3 compared to what is 
observed in figure 1 for zero magnetic field and figure 4 
(see below). There are two factors which make numeri- 
cal simulations of spin glasses in a magnetic field much 
more difficult. The first one is related to the difficulty 
of thermalizing spin-glasses at low temperatures. When 
the field is switched on the critical temperature is pushed 
down (as figures 2 and 3 clearly show). This makes ther- 
malization in the low temperature region more difficult. 
The second factor is related to the fact that Eq.(0) re- 
stores the TRS at zero magnetic field. Consequently, it 
is natural to expect the existence of a crossover length 
Lc (which increases as the magnetic field decreases) such 
that above Lc the finite-field fixed point dominates the 
scaling behavior while below Lc the scaling behavior is 
dominated by the zero field fixed point. In the case of 
figure 3 the crossover length was previously estimated 
(Lc — 5 1 11 1). This crossover effect manifests as a dis- 
placement of the crossing point to lower temperatures as 
the size increases. For large sizes (and always within er- 
rors) the crossing point stays around T,. ~ 1.2, a value 
for the critical temperature which has been estimated 
also through other methods 



crossing point corresponds to a universal amplitude we 
find (after examination of the data for the SK and the 
4D Ising spin glass at zero and finite field), that Gc — 
G{T = Tc) clearly increases with the field. This result 
suggests (in case the previous assumption is correct) that 
the transition without a field and in a field are determined 
by different fixed points |15||. 
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FIG. 4. G in the model without TRS symmetry with 
three-spins interaction and two spins per site. We find that 
Tc — 2.62. Error bars are shown for L — 3,6. 
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FIG. 3. G in the 4D ±J Ising spin glass at h=0.4. The 
number of samples is 2560, 1280, 704, 64 for L = 3, 5, 7, 9 re- 
spectively. Error bars are shown for L = 3, 9. 

Assuming that the value of the parameter G at the 



To check that the parameter G is indeed a good tool to 
determine RSB transitions it would be more convenient 
to consider a model where there is no external small pa- 
rameter (like the field) which can restore the TRS. For 
such a model there will not be a crossover length Lc and 
a crossing point for the parameter G should be easier to 
see already for small sizes. To confirm these expectations 
we have investigated model ^ with J*'^ = ±1 in four 
dimensions in lattices of sizes L — 3,4,5,6 with 100000 
MCS of statistics per temperature. The results are shown 
in figure 4. From (^) it is clear that there is no global 
symmetry in this model and the only possible phase tran- 
sition we can expect is a first-order one. We have verified 
that there is no latent heat and that the order param- 
eter (q) BG does not experience any discontinuous jump 
at any finite temperature. Having discarded the usual 
thermodynamic first-order transition scenario the only 
possibility left is the existence of a RSB transition where 
the spin-glass susceptibility diverges. Indeed our results 
show an algebraic divergence of the spin-glass suscepti- 
bility XSG and a least-squares fit gives XSG ~ {T — Tc)~^ 
with Tc — 2.63 and 7 ~ 1.0. This value of Tc is in striking 
agreement with the crossing point observed in figure 4. 
If one assumes, as said before, that G{T) ~ G{L/^) with 
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^ - (T-Tc)-" then {dG/dT)T=T^ - L". A power law fit 
yields u ^1/2 suggesting that both 7 and v are close to 
mean-field values. Let us note that the same conclusions 
are obtained by studying the parameter a in eq.(^. 

Summarizing, we have proposed a new parameter G 
based on exact inequalities initially derived by Guerra 

. This parameter is suited to numerically study replica 
symmetry breaking transitions. The physical meaning of 
G is related to the very nature of the replica symmetry 
broken phase, i.e. the absence of self-averaging in the 
order parameter. When replica symmetry is not broken 
the spin-glass order parameter is self-averaging but this 
property is lost in the broken phase. The parameter G in 
eq.(|) has the good properties of being bounded and pos- 
itive (a property which does not have the usual Binder 
parameter used for spin-glasses without TRS) and can be 
used as a good indicator for RSB transitions using finite- 
size scaling methods. At high temperatures G goes to 
zero as\/V where V is the volume of the system while at 
low temperatures it converges to 1/3 in the L — > cx) limit. 
The method can be also used to investigate transitions 
where TRS breaks. In particular, we have investigated 
the 4D Ising spin-glass at zero field and found that in- 
deed RS breaks at Tc. This result unambiguously shows 
that both TRS and RS break at Tc- But its greatest po- 
tential applicability concerns disordered models without 
TRS. In particular, we have considered spin glasses in a 
magnetic field (the SK model as well as the 4D Ising spin 
glass) which clearly show the existence of two different 
regimes corresponding to different self-averaging proper- 
ties of the order parameter. But the nicest application 
of the method is for models where there is no tunable 
parameter which restores time reversal symmetry (like 
the magnetic field). By introducing a new short-range 
p-spin model (eq.(|6|)) we have shown that G is indeed a 
good indicator for RSB. We have considered a model with 
p = 3 in 4D and we have shown that there is no thermo- 
dynamic first phase order transition. In this case G dis- 
plays a crossing point where the spin-glass susceptibility 
diverges. Finally, we want to stress that the information 
gathered from G in models without TRS cannot be ex- 
tracted in an easy way from the usual standard cumulants 
of the sample averaged P{q)- The genuine property of 
replica symmetry breaking transitions in disordered sys- 
tems is the non self-averaging character of the spin-glass 
order parameter, a feature which is specifically taken into 
account within the present method. A more deep under- 
standing of the appropriate renormalization group ap- 
proach in spin glasses is certainly needed to clarify the 
appropriate theoretical framework to deal with this type 
of phase transitions. 
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